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We study the effects of a fourth generation t' quarlc in various extensions of the standard model. 
In the Randall-Sundrum model, the decay t' tZ has a large branching ratio that could be detected 
at the Large Hadron Collider (LHC). We also look at the two-Higgs doublet models I, II and III, and 
note that, in the latter, the branching ratio of t' — > tcp, where is a Higgs scalar or pseudoscalar, is 
huge and we discuss detection at the LHC. 



I. INTRODUCTION 

Interest in a sequential fourth generation has waxed 
and waned over the years [TJ [2]. Shortly after the 
discovery of the third generation, a fourth genera- 
tion was an obvious extension. However, interest in 
a fourth generation dropped substantially after mea- 
surement of the number of light neutrinos at the Z 
pole showed that only three light neutrinos could ex- 
ist. The discovery of neutrino oscillations suggested 
the possibility of a mass scale beyond the standard 
model, and models with a fourth generation contain- 
ing a sufficiently massive neutrino became acceptable. 
In the early part of this decade, it was thought ,3 that 
electroweak precision measurements ruled out a fourth 
generation, however it was subsequently pointed out 
[!:_ that if the fourth generation masses are not de- 
generate, then these constraints can be evaded. More 
recently, Kribs et al. [5] showed that a mass splitting 
of 40 — 60 GeV between the fourth generation quarks 
results in S and T parameters which are within the 
one-sigma error ellipse. 

Most analyses of the phenomenology of a sequen- 
tial fourth generation have focused on the minimal 
Standard Model. In this paper, we consider the phe- 
nomenology of the fourth generation t' in popular ex- 
tensions of the Standard Model. In Section II, we 
discuss the Randall-Sundrum model and show that 
one expects a relatively large branching ratio for the 
flavor-changing decay t' — > tZ, which could be de- 
tected at the LHC. In Section III, we study the two- 
Higgs doublet models (Models I, II and III) , and show 
that in Model III, the decay t' — > t(p, where (p is ei- 
ther a Higgs scalar or pseudoscalar, can have a huge 
branching ratio (as high as 95%) and we discuss the 
rather dramatic phenomenology at the LHC. Finally, 
in Section IV, we present our conclusions. 

II. RANDALL-SUNDRUM MODEL 

The Randall-Sundrum model (RSI) [6] is a popular 
solution to the hierarchy problem, where the warped 



geometry of an additional dimension is responsible for 
generating TeV scale physics from a more fundamental 
Planck scale. In the original RSI model, the standard 
model (SM) fields were confined to the TeV brane, but 
it was quickly noted that they could be placed in the 
bulk without problems [21 [H |9] . This led to a natural 
resolution of the flavor hierarchy problem. 

In the basis of diagonal bulk masses, the normalized 
wavefunction of zero-mode fermions is given by [TJ [5J 

m 

where (3 = kRir k, 37, 1/fc < z < /k and c/ is 
the 5-D mass parameter describing the location of the 
fermion in the bulk. For c/ < 1/2 (c/ > 1/2) the 
fermion iff lives near the TeV (Planck) brane since 
its resulting Yukawa coupling with the Higgs field be- 
comes large (small). Since the Kaluza-Klein (KK) 
modes lie near the TeV brane, the heavier fermions 
have larger couplings to KK bosons. As noted by 
Agashe et al. [TOj [H], there is mixing between the 
Z-boson and the KK-Z boson, resulting in a shift of 
the fermionic couplings to the Z. 

In this model, the portion of the Lagrangian respon- 
sible for SM flavor violation is given by [11] 

~ g.(3AZ^ Y.^f\,^{vf - an,)i^f\ (2) 

^here = and A = . The vector 

and axial vector coefficients depend on the fermion ijjf 
and are given hy Vf = — sin 9w , and af — . 
The constants // are given in terms of equation [T] by 

V2k/ff = f(°\cf,ef^/k). Lastly, is the zero- 

mode of the 4-D fermion field in the basis of diagonal 
5-D bulk masses. However, this basis is not the same 
as the basis in which the 4-D mass terms are diagonal. 
This gives rise to flavor violating terms in the 4-D ba- 
sis, which have larger couplings for heavier fermions. 

Using this formalism, Agashe et al. [10] point out 
that with three generations, the branching ratio for 
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t^cZ is of 0(10-5) for a KK-Z mass of 3 TcV. This is 
a significant increase from the SM value. In the case of 
a fourth generation however, there are no electroweak 
precision constraints and so very large flavor changing 
neutral currents (FCNC) are allowed. In particular, 
one expects to observe t' ^ tZ at a large rate. Due to 
the fact that the t' and the b' have nearly degenerate 
masses, the decay of the t' is dominated by t' Wb 
unless the mixing angle is very small. Thus the decay 
rate for f Wb is proportional to |Vt'f,p ~ l(C^/)34p; 
where (Uf) is the mixing matrix that arises when ex- 
panding out the 4-D fermion flelds from equation [2] 
in the basis of diagonal 4-D mass terms. Thus the 
jVt'bp factor in T{t' — > Wb) conveniently cancels the 
|(J7j)34p factor in T{t' tZ) when calculating the 
branching ratio BR(t' tZ). 

The decay rate and branching ratio for t' — s- tZ de- 
pend on the four 5-D mass parameters for the left and 
right handed t and t' . Two of these can be eliminated 
in favor of the t and t' masses. Using the central value 
of Ct^ given by Agashe [TT] , the number of free param- 
eters is reduced to the t' mass and the fermion mass 
parameter Cj'^ , which describes the location of the t' 
in the bulk. 

The results for the branching ratio are given in Fig- 
ure 1 for t' masses of 400 and 500 GeV. As one varies 
the third generation mass parameter ct^ parameter 
(discussed in the previous paragraph) over a reason- 
able range, this result changes by less than a factor of 
two. We flnd a branching ratio of 0(10^'^ — 10"^). 

ATLAS PJJ has claimed that a bound of lO"'^ can 
be reached in 100 fb~^ for t cZ. Since the Z energy 
in the t' tZ decay is similar to that in t ^ cZ, one 
can get a rough estimate of the sensitivity by simply 
scaling this by the production cross section. This gives 
a sensitivity of 10"'^ for t' tZ. One can probably 
do substantially better if one includes the fact that 
the t in the decay can be detected, which will help 
eliminate backgrounds. It is clear that this places the 
decay within reach of the LHC, although a more pre- 
cise analysis would be welcome. 

How does this branching ratio compare with other 
models? The most comprehensive study concerning 
FCNC in the four generation Standard Model is the 
work of Arhrib and Hou |13j . They considered loop in- 
duced FCNC decays of fourth generation quarks, plus 
effects of fourth generation quarks on FCNC decays 
of third generation quarks. They found that the de- 
cay t' tZ can occur in the standard model with a 
branching ratio of 0(10"^ — 10~^) and suggest that 
this may be measurable at the LHC. In the Randall- 
Sundrum case, the branching ratio will be larger by 
approximately a factor of 100. What about flavor 
models? We know of no such models for four gen- 
erations. One of us (MS) is studying such a model, 
but the rate will be similar to that of Arhrib and Hou 
(additionally, flavor models do not typically give large 
rates for t cZ). It is also likely that other mod- 
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FIG. 1: Branching Ratio for t' tZ as a function of the 
fermion mass parameter Ct' . 



els will have a rate for t' tj or t' tg which is 
comparable to t' tZ, unlike the Randall-Sundrum 
case. 



III. TWO HIGGS DOUBLET MODELS 

Among the most popular extensions of the Stan- 
dard Model are two Higgs doublet models [13]. The 
most common is called Model II. In the two Higgs 
doublet model II, due to a discrete symmetry, the 
down-type quarks and leptons couple to one com- 
plex doublet (pi while the up-type quarks and neu- 
trinos couple to the other 02- The ratio of vacuum 
expectation values (vev) is a free parameter deflned 
by tan(/3) — V2/V1. By requiring that the theory 
be perturbative we obtain a bound on the possible 
values of tan(/3). The Yukawa couplings of fourth 
generation quarks are given by gt'/V"^ — iTit'/v2 and 
gf,,/^/2 = rrib'/vi, where ^ vf + (246GeV)2. 
If we approximate rrit' ~ mf,/ = Af > 280 GeV and 
relate vi and V2 to the Standard Model Higgs vev v 
in terms of tan(/3), then the theory will remain per- 
turbative, gf, < Att and g^, < in, only if 

, I, , < tan(/3) < y'2n{v/M)^ - 1 . (3) 

Thus for Model II with M > 280 GeV we find 1 /2 < 
tan(/3) < 2. In Model I the 0i field does not couple 
to fermions, which eliminates the upper bound, the 
lower bound however remains unchanged. 

Issues of perturbation theory and vacuum stability 
pose a challenge to four-generation models. As noted 
most recently by Kribs [5], in the Standard Model 
the large Yukawa couplings will cause the scalar self- 
coupling to either go negative (leading to vacuum in- 
stability) or reach a Landau pole well before the GUT 
scale. The Yukawa coupling itself can also reach a 
Landau pole at relatively low scales. Although meth- 
ods can be found to extend the reach of perturbation 
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FIG. 2: Branching Ratio for t' — > Wb as a function of the 
ratio M[j+ /Mt' . 



theory [15], they do involve addition of new physics 
just above the TeV scale. In the two Higgs doublet 
models, the situation is much more complicated since 
there are many scalar self-couplings, many other vacua 
(such as charge-breaking vacua) and many other op- 
portunities for instabilities. Our approach here is to 
assume that the two Higgs doublet model is an effec- 
tive theory below the TeV scale, and will presume that 
physics above that scale will not substantially affect 
our results. 

Since the charged Higgs H"^ is a possible decay 
product of the t' through the decay t' — > Hb, and 
this decay will be very difficult to observe, there 
will be a slight suppression in the branching ratio 
BR(t' Wb), which is shown in Figure 2 as a func- 
tion of the charged Higgs mass. 

A much more interesting situation arises in Model 
HI. In Model HI, there is no discrete symmetry pro- 
hibiting tree level flavor changing neutral currents. 
Initially this appears to be very problematic. How- 
ever if one goes to a basis in which one of the scalar 
fields gets a vacuum expectation value and the other 
does not, then the couplings of the latter, 0, will be, in 
general, flavor changing. By analyzing various mass 
matrix textures, Cheng and Sher [TB] argued that flne- 
tuning can be avoided if the flavor changing neutral 
couphngs ^ij7ifj(l> are given by 



(4) 



and the couplings Xij are of 0{1). In other words, the 
flavor changing Yukawa couplings are the geometric 
mean of the two Yukawa couplings of the fermions in- 
volved. Model HI is defined as the two Higgs doublet 
model with Yukawa couplings given by the above ex- 
pression. Recent studies [17' of heavy quark mixing 
and decays have begun exploring interesting regions of 
parameters space (which depends on the \ij and the 
relevant Higgs masses). Note that in this model, the 
flavor changing couplings of the light quarks are very 
small, and the constraints from kaon physics are not 



as severe. Only a few studies of Model HI have been 
done [iHJ [m |20] involving fourth generation fields. 

In this Model, one would expect an enormous fla- 
vor changing coupling between the i', the t and the (j). 
The coupling, in fact, would be substantially larger 
than the top quark Yukawa coupling. If kinematically 
accessible, then one would expect t' — > t0 to over- 
whelmingly dominant t' decays. Here, <f> can be the 
combination of neutral scalars that is orthogonal to 
the state that gets a vev, or it can be the pseudoscalar. 
In either event, this decay will dominate. 

The cross section for producing a 400 GeV t' is 15 
picobarns [51]. Virtually all of these t's will decay 
into t(f), leading to a dramatic ticfxj) signature. If is a 
pseudoscalar or a neutral scalar lighter than about 140 
GeV, then it will decay into 66, leading to a 66, 2W fi- 
nal state. The biggest Standard Model background to 
these events would come from double pair production 
of tthb. The cross section for this background [22] is 
approximately 2 picobarns, and it gives a 46, 2W final 
state. If one only looks at events with three or more 
tagged 6's and one or more leptons, and assumes a 6- 
tag efficiency of 40%, then the signal will pass the cut 
20% of the time, and the background will pass the cut 
8% of the time, leading to a signal of 3150 fb and a 
background of only 160 fb. Thus, it appears that the 
signal will easily be detectable, possibly in an early 
run at the LHC. 

If </) is a neutral scalar heavier than 140 GeV, then 
it will decay into WW leading to a 26, 6M^ final state. 
Here, if one looks at events with three or more leptons 
and one or more tagged 6's, then 12% of the decays 
will pass the cuts, leading to an event rate of 1.8 pi- 
cobarns. We know of no standard model background 
that comes close to this signal. This signal would also 
be easily detectable at the LHC. 



IV. CONCLUSIONS 

There continues to be interest in the phenomenol- 
ogy of a sequential fourth generation. Yet almost 
all discussion have been in the context of the Stan- 
dard Model. In this paper, we have explored the phe- 
nomenology of the fourth generation, focusing on the 
t' quark, in extensions of the Standard Model. In the 
Randall-Sundrum model, the decay t' — > tZ can occur 
at a rate approaching one percent, which should be de- 
tectable at the LHC. In two-Higgs doublet model, one 
gets a suppression of the branching ratio t' — > Wb in 
Models I and II, but in Model HI the decay of t' t(j), 
where (/) is a scalar or pseudoscalar, dominates the 
decay, leading to spectacular ttcjxl) signatures at very 
large rates, which could be detected during the early 
months of running at the LHC. 
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